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Abstract 



Wc study the matroid secretary problem when the valuation is defined by a submodular 

^SJ ' function. In this problem, the elements of the ground set of a matroid are arriving in random 

order. When one element arrives, we have to make an immediate and irrevocable decision 
regarding whether or not to accept it. Our objective is to select an independent set under the 

rv^ , given matroid, so that the valuation of the set is maximized with a submodular function. 

/^ ' Our major result is a constant-competitive algorithm for the submodular matroid secre- 

tary problem under transversal matroids with monotonically increasing submodular valuation 
functions. In addressing it, we instead develop a constant competitive algorithm for a more 
general online bipartite graph matching problem. As a natural special case, we also consider 
the secretary problem under partition matroids and provide an extremely simple algorithm 
which can handle non-monotone submodular functions. This algorithm significantly improves 

QQ ' the competitive ratio over the previous work. 
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1 Introduction 

Secretary problems study the algorithms to accept elements with largest weights under certain 
constraints. The elements are arriving in random order and we have to make an immediate and 
irrevocable decision to whether take the current element as output or not. In the classical secretary 
problem [HI \TT\ I12| . one interviewer is interviewing n candidates for a secretary position. The 
candidates are arriving in random order and the interviewer has to decide whether or not to hire 
the current candidate when she arrives. The goal is to hire the best secretary. 

Notice that if the arriving order of the candidates is adversarially chosen, one cannot hope 
for an algorithm with reasonable chance to hire the best secretary. However, the random order 
assumption in the secretary problem setting is essential for practical solutions. In particular, for 
the classical secretary problem, we can observe first n/e candidates without hiring anyone. For 
subsequent candidates, we immediately hire the current candidate if she is better than anyone we 
have seen so far. It is not difficult to show that this mechanism will successfully hire the best 
secretary with probability 1/e, if the candidates are arriving in random order. 

Recently, Babaioff et al. [3] formulated the matroid secretary problem. Instead of hiring one 
candidate (element), the matroid secretary problem seeks to select a set of elements which form an 
independent set in a matroid. Again, the elements are arriving in random order and the weights 
of the elements are revealed when they arrive. Our objective is to maximize the total weights 
of the selected elements. They gave an 0(logr)-competitive algorithm for a general matroid, i.e. 
the expected total weights of the elements selected by the algorithm is $7(1/ log r) of the optimal 
solution. They conjectured that any matroid secretary problem allows a constant competitive 
algorithm. This conjecture is still widely open, while constant competitive algorithms have been 
found for various matroids: uniform/partition matroids[2l [16], truncated partition matroids[3], 
graphical matroids [U [IT], transversal matroids [71 [T7] and laminar matroids [15]. 

In the matroid secretary problem, the weights are associated to elements and we aim to pick 
elements with large weights. In some scenarios, it is more natural to measure the quality of a set 
by a valuation function, which is not necessarily linearly additive. One set of functions widely 
used in the optimization community is the submodular functions. Such functions are characterized 
as functions with diminishing returns. Let [n] = {1,2, ... ,n} be the set of total elements. A 
function / : 2^ ^ R is submodular if f{S U T) + f{S DT) < f{S) + f{T) for S,T <Z [n]. For 
an alternative definition, a function / is submodular iff for any S" C T C [n] and element x £ [n], 
f{S U {x}) - f{S) > f{T U {x}) - f{T). 

It is natural to extend the matroid secretary problem with submodular functions. In other 
words, the weights are not directly associated with elements. Instead, there exists an oracle to 
query the function value for any subset of the elements we have seen. Gupta et al. [13] studied 
the non-monotone submodular matroid maximization problem for both offiine and online (secre- 
tary) versions, i.e. to find an independent set S such that f{S) is large where /(•) is a given 
(possibly non-monotone) submodular function. For the online (secretary) version, they provided 
a 0(logr)-competitive algorithm for general matroids and a constant competitive algorithm for 
uniform matroids (algorithms achieving constant competitive ratios are obtained independently 
by Mohammond[4| et al.) and partition matroids where only one element can be selected from 
each group. The submodular function poses serious challenges in developing constant competitive 
algorithms. In particular, in most cases, we are working with marginal valuation functions, which 
depend on the set of elements has been selected. Such dependencies greatly complicate the analysis, 
and have to be addressed very carefully. 



Our results. We provide constant competitive algorithms for the submodular matroid secre- 
tary problem for transversal matroids and partition matroids. 

Theorem 1.1 There is a A^- competitive algorithm for the matroid secretary problem under a 
transversal matroid with a monotonically increasing submodular valuation function. 

This algorithm is developed to solve a more general bipartite vertex-at-a-time matching problem 
with a submodular valuation function on the set of edges. Notice that partition matroids are 
special cases of transversal matroids. So our result for the transversal matroids already provides 
an improvement comparing with the algorithm in [14]. However, this algorithm cannot handle 
non- monotone submodular functions. 

We then develop an algorithm for the non-monotone submodular secretary problem under par- 
tition matroids, which achieves a significantly better competitive ratio. 

Theorem 1.2 There is an 18-competitive algorithm for the submodular matroid secretary problem 
under a partition matroid. When the valuation function is monotonically increasing, the competitive 
ratio can be improved to 5. 

Our result for the transversal matroid case can be extended to the online matching problem in 
hypergraphs as in [T7]. The algorithm for the partition matroid can be extended to the case that 
one can accept a fixed number of elements from each group, using techniques in [^. Also, it is 
straightforward to solve the case for graphical matroids. 

Some techniques. With a submodular valuation function /(•), the previously accepted ele- 
ments will affect the valuation of the arriving ones. In this paper, however, we show that one can 
treat the submodular function "obliviously" in the cases of the transversal and partition matroids. 
In fact, our algorithms are simple adaptations from the corresponding algorithms with linearly 
additive valuation functions. On the other hand, the analysis in the submodular case requires new 
techniques. 

For the transversal matroids, we simulate an online algorithm with a randomized greedy al- 
gorithm in Algorithm [3l The randomized greedy algorithm greedily selects elements with highest 
marginal value with respect to M, which is empty at first. However, with half probability, the 
element may either go to M or A'^, where N is the set of candidates our algorithm would accept. It 
is natural to expect that f{M) is large. Our result implies, on the other hand, f{N) = r2(/(M)). 
This is rather surprising, since the greedy algorithm is always choosing elements with good marginal 
value respect to Ml To achieve this, we examine the function f{N) + {f{N) + f{M) - f{MUN)). 
LJ The second term can be viewed as the intersection of M and A^. In particular, we show that 
in each step of the randomized greedy algorithm, either /(A") grows or f{N) + f{M) — f{M U A^) 
grows in expectation. This observation although simple, is critical in our analysis and we believe 
it might be useful to further understand the submodular secretary problem under other matroid 
constrains. 

For the partition matroids, our algorithm is running r parallel classical secretary algorithms on 
each group of elements. The valuation function is the marginal valuation function with respect to 
the current set of accepted elements. This is counter-intuitive since the decision for the elements 
in one group depends critically on the decisions on other groups. Nevertheless, our analysis shows 
a constant competitive ratio for this simple algorithm. 



^In the analysis, we inspect the set S C N instead. 



In the analysis, we define the partial permutation set X-i to group permutations that have the 
same positions for elements in all groups other than group i. This grouping is extremely useful to 
decouple the dependencies between the permutation and the marginal valuation function used in 
accepting one element from group i. We show the element in group i that our algorithm accepts is 
expected (over a particular permutation group in X-i) to be "good" comparing with the element of 
the optimal solution in group i with respect to the previously accepted set of elements, which itself 
is a random variable. Therefore, overall, the set of elements accepted by our algorithm is good. 

Related ■work. The secretary problem has been studied decades ago, which is first published 
in [12] and has been folklore even earlier [9]. Motivated by the simple optimal solution for the 
classical secretary problem, several results have appeared for solving more complicated problems in 
this random permutation model. Usually, the goals is to find an independent set which maximize the 
total weight. For example, Kleinberg [16] gave a 1 + 0(l/vA;)-competitive algorithm for selecting 
at most k elements to maximize the sum of the weights. Babaioff et al. [2| considered the Knapsack 
secretary problem, in which each element has weight and size, and the objective is to find a set 
of elements whose total size is at most a given integer such that the total weights are maximized. 
They gave a constant competitive algorithms. Random permutation model is also considered in 
other problems to improve the solution feasibility, e.g. online ads problem [HJ [13], robust stream 
model [5]- 

Babaioff et al. [3] systematically introduced the matroid secretary problem, in which the solution 
has to be an independent set of a matroid and the goal is to find the independent set with maximum 
total weights. As we mentioned earlier, various special cases admit constant competitive ratios. 
The major open problem is to find a constant competitive algorithm for general matroids, if there 
exists. 

The submodular matroid secretary problem, [H [T3] introduces another freedom in the matroid 
secretary problem by allowing the evaluation function to be submodular instead of simply linearly 
additive. Constant competitive algorithms have been developed for the uniform matroids and the 
partition matroids. 

2 Preliminary 

In the matroid secretary problem, we assume the elements are arriving in random order. Our 
algorithms have to decide whether to take the current element or not when it arrives. The decision 
cannot be revoked and the set of accepted elements has to form an independent set in the given 
matroid. 

2.1 Submodular functions 

In this paper, we assume the quality of the solution is measured by a submodular function. Notice 
that throughout this paper, we only work with non-negative functions. For transversal matroids, we 
assume the submodular function is monotonically increasing. Our algorithm for partition matroids 
works with non-monotone submodular functions as well. 

Definition 2.1 Let U be the ground set. Let /(•) : 2 ^ R be a function mapping any subset of 
U to a real number. /(•) is a submodular function if: 

\/S, TQU, fiS) + /(T) > f{S U T) + f{S n T). 



For simplicity, for any set S* C [/, we define /s(-) as follows. For any T <^ U, fs{T) = 
f{S U T) — f{S). It is not difficult to see that fs{-) is submodular if /(•) is submodular. For 
simplicity, when T = {t} is a singleton, we also write f{t) = f{{t}). 

2.2 Matroids 

In the matroid secretary problem, the set of accepted elements must form an independent set 
defined by a given matroid. 

Definition 2.2 (Matroids) Let U ^ f}> be the ground set and I be a set of subsets of U . The 
system Ai = {U, X) is a matroid with independent sets I if: 

1. If AC B CU and B el, then A el. 

2. If A, B e I and \A\ < \B\, there exists an element x e B \A such that A U {x} G I. 

In this paper, we work with the following two matroids. 

Definition 2.3 (Transversal matroids) Let G = {L,R,E) be an undirected bipartite graph with 
left nodes in L, right nodes in R and edges in E. In the transversal matroid defined by G, the 
ground set is L and a set of left nodes S '^ L is independent if there exists a matching in G such 
that the set of left nodes in the matching is S. 

Definition 2.4 (Partition matroids) Let [/ = C/i U f/2 U • • • U f/^ be the ground set with disjoint 
subsets Ui and Hi = \Ui\. In the partition matroid defined by M = {U,I), S <ZU is independent if 
ViE [r], |5nC/i| < 1. 

2.3 Submodular Bipartite Vertex-a-time Matching Problem 

The transversal matroid is defined on matchings of a bipartite graph. Korula and Pal [T7] gener- 
alized the transversal matroid secretary problem to an online bipartite graph matching problem, 
motivated by [7]. We further generalize to submodular valuation functions. In particular, we 
introduce the Submodular Bipartite Vertex- at- a-time Matching (SBVM) problem. 

In the SBVM problem, there is an underlying bipartite graph G{L U R,E). We are given the 
set of right nodes R. The nodes in L, however, are arriving sequentially in random order. When a 
vertex i € L arrives, all edges incident to i are revealed. We assume the availability of an oracle 
for the submodular valuation function, which we can query the function value for any subsets of 
the edges we have seen. We must immediately decide to accept an edge to match i with a vertex 
of R or drop all edges incident to L 

We claim that the matroid secretary problem under a transversal matroid is a special case of 
the SBVM problem, when the valuation function is submodular. In particular, the valuation on L 
in the transversal matroid can be extended to the valuation on the edges E. Let /(•) be a function 
defined on the subsets of L. We define a function g{-) on the subsets of E as follows: for E' C E, 
g{E') = f{L n £"), where L n £" is the set of left nodes incident to E'^ 

Lemma 2.5 // /(•) is a monotonically increasing submodular function, g{-) is monotonically in- 
creasing submodular. 



The ties in tlie valuation function liave to be broken in a consistent way. 



Hence, for the submodular inatroid secretary problem under a transversal niatroid, we can 
extend the valuation function on L to the set of edges in the underlying bipartite graph. The 
optimum solutions for both problems are the same. In fact, if we find a matching, which is a good 
approximation of the SBVM problem, the left nodes of the matching is a good approximation of 
the matroid secretary problem with the same approximation ratio. 

3 Algorithm for the SBVM Problem 

Notice that all submodular functions used in this section are monotonically increasing. Recall from 
Section [2] that the submodular matroid secretary problem under a transversal matroid is a special 
case of the submodular bipartite vertex-at-a-time (SBVM) problem. In this section, we show that 
an adapted algorithm from that of [3 |T7] gives a competitive ratio of 48 for the SBVM problem. 
Our adaptation is based on the following algorithm GREEDY. 



Input: G = {L,R,E) and function /(•) 


Output: Matching S 


5^0; 


while {e S" U {e} is a matching} ^ do 




e* = argmaxe{/s'(e) S U {e} is a matching}; 




S ^SUe*] 


end 


return S; 



Algorithm 1: GREEDY 

Lemma 3.1 For a bipartite graph G{L,R,E) and a monotonically increasing submodular function 
/(•) > defined on all subsets of E, GREEDY is a 3 -approximate algorithm. 

We now present our algorithm ONLINE for the SBVM problem. When /(•) is linearly additive, 
this algorithm is identical to the algorithms in [TJE]- But in general submodular case, our algorithm 
based on GREEDY is simpler and clearer . 

In the algorithm, we first observe k = Binom{\L\, 1/2) number of left nodes H while rejecting 
all edges incident to them, where k is the binomial random variable. We build the matching M 
by running GREEDY on the edges E D {H x R). For any subsequent left node (., again we run 
GREEDY on the edges E n {H U {£} x R) to build a new matching M^. If there exists an edge e^ 
incident to I in Mi, we add ei into A^, which is a set maintained for later analysis. The edge eg is 
accepted by our algorithm if it forms a matching with the set of accepted edges so far. 

Korula and Pal [17] observed that there is a randomized offline algorithm which can simulate 
their online algorithm. In our case, we also describe a closely related algorithm SIMULATE as 
Algorithm [3l SIMULATE is easier to analyze, since it simulates the randomness of the input in 
ONLINE by its internal random coins. In SIMULATE, we have a reference matching M, a working 
set A'' and a result set 5 C A. 

We start with two empty sets M and N . At each time, we pick an edge e = (£, r) greedily with 
respect to function /a/(") such that M U {e} is a matching. We then flip a coin. If the coin is head, 
e is added to M. Otherwise, it is added to N . In both cases, we remove all edges incident to L 
The algorithm stops when no edge can be picked. 



Input: G = {L,R,E) and function /(•) on E. 
Output: Matching ALG. 

k <— Binom{\L\, ^); 

Observe H ^ the first k vertices of L and reject all edges incident to H; 
E' ^ En{H xR); 
M ^ GREEDY ( G{H, R,E')); 
ALG,iV^0; 

for each subsequent £ £ L\H do 
Ee^En{HU{£} xR); 
Mi ^ GREEDY {G{H U {e},R,Ee)y, 
if M£ / M then 

Let ei be the edge in M^ incident to i; 
N = Nu{ee}; 

if ALG U {ei} is a matching then 
ALG^ ALGu{e4; 
Accept ei] 
Continue; 
end 

Reject all edges incident to I; 
end 
end 



Algorithm 2: ONLINE for the SBVM Problem 

We introduce the two observations about SIMULATE from [17]: Once any edge incident to a 
vertex i £ L has been picked, no other edge incident to i will be picked later since we remove all of 
them. Second, multiple edges incident to r £ R might be picked until one of these edges is added 
to M. As a consequence, at the end of SIMULATE, M is a matching, but N might not be. 

Our final pruning step takes care the case that A'^ is not a matching, i.e., there are multiple 
edges incident to the same vertex of i? in A^. The final output is a matching S. We will prove that S 
is a constant approximation. Before that, we justify the usefulness of SIMULATE by the following 
lemma, which is implicitly assumed in [T7]. We give a proof in the appendix for completeness. 

Lemma 3.2 The sets of edges of M and N by SIMULATE has the same joint distribution as the 
M and N generated by ONLINE with a random permutation of the left nodes L. 

3.1 Analysis of ONLINE and SIMULATE 

Let OPT be the optimal matching in G. We first study the performance of M. The following 
lemma is very intuitive. 

Lemma 3.3 E[/(M)] > i/(OPT) . 

Let Eg be the set of edges picked in SIMULATE. Define Mg be the set of edges in M when e is 
picked. For each node r G R, define e^ € Es as the first edge incident to r picked in SIMULATE; 
define m^ G M as the edge incident to r. By the submodularity of /(•) and the greedy algorithm, 
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Input: G = {L,R,E) and function /(•) 


Output: The set of selected edges S 


M, iV, 5 ^ 0; 


while 3 e* = {i*,r*) = argmaxegg {/jv/Ce) ML) {e} is a matching } do 




Flip a coin with probability 2 of head; 




if head then M ^ M U {e}; 




else A^^ A^U{e}; 




Remove all edges incident to i* from E; 


end 


foreach edge e = {£,r) e N do 


Add e to 5 if e is the only edge incident to r in A^; 


end 


return S; 



Algorithm 3: SIMULATE 

we have /m^^ (cr) > fMmr ("^r)- (Both e^. and nir are random edges, which may not exist. We define 
the /r(e) = when e does not exist.) Since /(M) = X^^gjij /m™,^ (?^r), the following proposition 
can be directly implied. 

Proposition 3.4 Erei? /Me.(er) > f{M). 

In order to show the performance of /(S"), it is sufficient to compare with YliT&RfMeri^r)- 
However, it is not even intuitively clear why there exists a relationship between these two quantities. 
In particular, recall that in SIMULATE, we always pick edges greedily respect to the current M, 
regardless of N and S. 

Instead, we inspect the function F{M, S) = f {S)+{f {M)+ f (S)— f {MUS)) during the execution 
of SIMULATE. The second term f{M) + f{S) — f{M U S) can be viewed as the intersection of 
M and 5. Intuitively, when we pick an edge e in SIMULATE, if /A/(e) and /s'(e) are comparable 
to each other, the growth of f{S) is good. On the other hand, in case that /5(e) << /M(e), with 
probability 1/2, e is added into M, in which case the "intersection" between M and S grows. The 
proof of the following lemma concretely implements this idea. 

Lemma 3.5 E[/(5)] > ^E [E.gR /M.,(e.)] 

Proof: Consider the function F{M, S). Let Mr and Sr be the set of edges in M and S respectively 
when the edge er is picked in SIMULATE. Denote M'^ and S', as the set of edges in M and S after 
Cr is processed. 

Define A^ = F{Ml,,S'j.) — F{Mr,Sr)- F{M,S) is monotonically increasing when edges are 
processed in SIMULATE. Therefore, F{M,S) > J2reR^r- Let J> be the sub-cr-algebra encoding 
all randomness up to the time e,. is picked in SIMULATE. Notice that M,-, Sr and e^ are J> 
measurable. 



E[A, I Fr] = Pr[e, G S \ Fr]{2fsAer) - /M.us.(er)) + Pr[e, G M \ J;](/M.(er) - /M.us.(er)) 

> |(2/S,(er) - fMrVJsAdr)) + -^ifMr{er) - /A/,U5.(er)) 

> ^/Mrl^r) - jfMrUSrier) 

The last two inequalities come from the submodularity of /(•). Therefore, 

2E[/(5)] > E[F{M,S)] = Y,n\] = Y,K^^[E[Ar\Fr]\ >\Y.^[fAUer)] 

r£R reR reR 

D 
Combing the analysis above, we have the following theorem. 

Theorem 3.6 There are A^-competitive algorithms for the SBVM problem and the suhmodular 
matroid secretary problem under a transversal matroid with monotonically increasing suhmodular 
valuation functions. 

4 Algorithms for the partition matroids 

In this section, we develop constant competitive algorithms for the suhmodular matroid secretary 
problem under partition matroids. Recall that an independent set in a partition matroid contains 
at most one element from each group. 

4.1 Monotone suhmodular functions 

We first discuss the case when /(•) is a monotonically increasing suhmodular function. Our algo- 
rithm is extremely simple, though the analysis for its performance is subtle to obtain. In fact, we 
parallel run r classical secretary algorithms on each group of elements in PARTITION. 

Let Id(-) be the function which returns the id of the group for a particular element. For group 
2, we observe the first nj/2 elements and reject all of them. For each sub-sequential element in Ui, 
we accept it if it is better than all elements we have seen in C/j, with respect to fs{') where S is the 
current set of accepted elements. (If the marginal value is negative, we do not accept the current 
element and any element from this group.) 

Notice that S is changing in our algorithm. Consider a particular group i and current S. It 
could be the case that we have missed the "best element" in group i respect to fs{') simply because 

5 was different when it arrived. So it is rather counter-intuitive that this algorithm is a constant 
competitive algorithm. 

We require more notations. Let OPT = argmax{/(T) | T G X} be the optimal solution and 
S € X be the output of our algorithm. For a given permutation p of elements in U , let S^ be the 
output of our algorithm. Denote OPTj (resp. Cj, e^) for i e [r] as the element of OPT (resp. 5, 
SP) in group i. Let Si (resp. S^) be the set of elements accepted by our algorithm when one of the 
iP-s is set to true in PARTITION. If all 6^ are false after the algorithm terminates, we set Si = S. 



Input: Partition matroid Ai = {U,I), function /(•) 
Output: The set of selected elements S £ I 

Vi E [r],Ti ^ 0, Vj E [n^], 6^' ^ false; S ^ 0; 
for eac/i element e £ U do 

^id(e) ^ rid(e) U{e}; 

if (Vj E [nM(e)],^d(e)^* /«^^e) A (|rid(e)| > ^) A (c = argmaXe'eTM(e){/5(e')}) then 

if /5(e) > then 
I 5 ^ 5 U {e}; Accept e; 
end 
end 
end 
return S; 



Algorithm 4: PARTITION 

Remark on Non-existence. In general, ej and ef may not exist. We evaluate fSi{e-i) and 
fsp{e^) to in this case. When /(•) is not monotone, OPTj may not exist as well, in which case 
friOPTi) = for any TCU. 

Our analysis crucially depend on the following definition to group the permutations of the 
arriving elements. 

Definition 4.1 (Permutation group) For a permutation p of elements U, define Pi{p) be the 
positions ofUi in p. For each i E [r], define the following equivalence relationship on permutations. 
For two permutations x = {xj},y = {yj} E V, they are equivalent if and only if 

Pi(x) = Pi{y) andMj ^ Pi(x), Xj = yj. 
Define X-i as the set of equivalence groups respect to i. 

For permutations in the same group in Af_j, they share the same positions for all elements 
except Ui. Define \p]i E X^i as the permutation group respect to i containing the permutation p. 
When the context is clear, we drop the subscript in \p\i and write \p] as we always consider the 
group i. 

For a permutation p, define the positions of Ui in p as {^1, . . . ,irn} in increasing order. Now 
define T^ be the set of elements accepted by our algorithm before ijth element arrives in p, if we 
force our algorithm to reject all elements in Ui. By definition, for any permutation <? E [p], T^ 

is identical to each other. Therefore, we write T- = T? for q £ [p]. We also define T'-^' be the 
elements our algorithm accepts with a permutation in [p], if we force our algorithm to reject all 
elements in Ui. 

We are interested in the probability that our algorithm accepts an element in group i as well 
as the quality of the element when it is accepted. The following lemma is critical in this section, 
which captures the interesting cases. 



Lemma 4.2 Let [x] E X-i he a permutation group, where x is a permutation. Let Pi{x) = 
{ii,i2, ■ ■ ■ ,^ni} be the set of positions for elements in Ui in increasing order. Let el he the ele- 
ment accepted hy our algorithm at position Ij . We have 



1. 


Vi G [nil Pr 


f{e\) >maxe6(7i{/7,w(e)} 


pG [x\ 


1 


~ 2(i-l) 


2. 


Vj G [n,], Pr 


6^ is true 


p£ [x] 


— rii 




~ 2iO-l) 




3. 


Pr 


Vj G [nil 


h\ is false 


pe [x] 


1 

~ 2 







In the first and the second cases above, we mark 6^ as true which imphes S\ = T by definition. 
In the third case, Sf = T'-^'. The following lemma compares the performance of OPTj with e^ 
respect to Sf. Notice that both 5^ and e^ are random variables. 

Lemma 4.3 Let [x] G X^i he a permutation group. Assume the elements are arriving in a random 
permutation p. We have 

E[fsfie,)\pG [x]] > ^E[fsfiOFT,)\pG [x]] . 

It is then straightforward to bound the performance of f{S). 
Lemma 4.4 K[f{S)] > iE[/(5U OPT)] 

When /(•) is monotonically increasing, we already have a constant competitive algorithm. 

Theorem 4.5 There is a 5-competitive algorithm for the matroid secretary prohlem under a par- 
tition matroid when the valuation function is a monotonically increasing suhmodular function. 

4.2 Non-monotone submodular functions 

We have shown that PARTITION is 5-competitive when /(•) is a monotonically increasing sub- 
modular function. Notice that, all the results in the previous section can be carried over to the case 
with non-monotone submodular functions. In order to achieve constant competitive ratio in the 
non-monotone case, we need the following simple result. Notice that we always assume /(•) > 0. 

Proposition 4.6 Let /(•) he a non-negative suhmodular function. For any sets A,B,C QU such 
that An B = f/i, we have: 

f{AuC) + f{BuC)>f{C). 

The proof is very simple. Notice that {AU C) n {B U C) = C as An B = iJ}. The inequality 
comes from the submodularity and non-negativeness of /(•). 
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Algorithm. We first decide to run our algorithm PARTITION in mode yl or S by a random 
choice. If we are in mode A, when we want to accept an element e in group i, we flip a coin. If 
the coin is head, we accept the element. Otherwise, we reject this element and never accept any 
element in group i in the future. Symmetrically, we do the opposite in mode B, i.e., only accept 
the element if the coin is tail. 

Our modification simplifies the process in [14]. Denote ALG^ (resp. ALGb) as the output of 
our algorithm in mode A (resp. B). Notice that ALGa and ALG^ have the same distribution and 
ALG^ n ALGb = 0- So it is sufficient to show 

E\ALGa] > -E[ALGa U OPT]. (1) 

9 

Detailed proofs are left in the appendix. Notice that our algorithm will randomly choose ALG^ 
or ALG^ based on the random choice before any element arrives. Clearly, this is an 18-competitive 
algorithm. 

Theorem 4.7 There is an 18-competitive algorithm for the matroid secretary problem, under a 
partition matroid when the valuation function is a suhmodular function. 
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A Introduction 

Secretary problems study the algorithms to accept elements with largest weights under certain 
constraints. The elements are arriving in random order and we have to make an immediate and 
irrevocable decision to whether take the current element as output or not. In the classical secretary 
problem [HI \TT\ I12| . one interviewer is interviewing n candidates for a secretary position. The 
candidates are arriving in random order and the interviewer has to decide whether or not to hire 
the current candidate when she arrives. The goal is to hire the best secretary. 

Notice that if the arriving order of the candidates is adversarially chosen, one cannot hope 
for an algorithm with reasonable chance to hire the best secretary. However, the random order 
assumption in the secretary problem setting is essential for practical solutions. In particular, for 
the classical secretary problem, we can observe first n/e candidates without hiring anyone. For 
subsequent candidates, we immediately hire the current candidate if she is better than anyone we 
have seen so far. It is not difficult to show that this mechanism will successfully hire the best 
secretary with probability 1/e, if the candidates are arriving in random order. 

Recently, Babaioff et al. [3] formulated the matroid secretary problem. Instead of hiring one 
candidate (element), the matroid secretary problem seeks to select a set of elements which form an 
independent set in a matroid. Again, the elements are arriving in random order and the weights 
of the elements are revealed when they arrive. Our objective is to maximize the total weights 
of the selected elements. They gave an 0(logr)-competitive algorithm for a general matroid, i.e. 
the expected total weights of the elements selected by the algorithm is $7(1/ log r) of the optimal 
solution. They conjectured that any matroid secretary problem allows a constant competitive 
algorithm. This conjecture is still widely open, while constant competitive algorithms have been 
found for various matroids: uniform/partition matroids[2l [16], truncated partition matroids[3], 
graphical matroids [U [IT], transversal matroids [71 [T7] and laminar matroids [15]. 

In the matroid secretary problem, the weights are associated to elements and we aim to pick 
elements with large weights. In some scenarios, it is more natural to measure the quality of a set 
by a valuation function, which is not necessarily linearly additive. One set of functions widely 
used in the optimization community is the submodular functions. Such functions are characterized 
as functions with diminishing returns. Let [n] = {1,2, ... ,n} be the set of total elements. A 
function / : 2^ ^ R is submodular if f{S U T) + f{S DT) < f{S) + f{T) for S,T <Z [n]. For 
an alternative definition, a function / is submodular iff for any S" C T C [n] and element x £ [n], 
f{S U {x}) - f{S) > f{T U {x}) - f{T). 

It is natural to extend the matroid secretary problem with submodular functions. In other 
words, the weights are not directly associated with elements. Instead, there exists an oracle to 
query the function value for any subset of the elements we have seen. Gupta et al. [13] studied 
the non-monotone submodular matroid maximization problem for both offiine and online (secre- 
tary) versions, i.e. to find an independent set S such that f{S) is large where /(•) is a given 
(possibly non-monotone) submodular function. For the online (secretary) version, they provided 
a 0(logr)-competitive algorithm for general matroids and a constant competitive algorithm for 
uniform matroids (algorithms achieving constant competitive ratios are obtained independently 
by Mohammond[4| et al.) and partition matroids where only one element can be selected from 
each group. The submodular function poses serious challenges in developing constant competitive 
algorithms. In particular, in most cases, we are working with marginal valuation functions, which 
depend on the set of elements has been selected. Such dependencies greatly complicate the analysis, 
and have to be addressed very carefully. 
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Our results. We provide constant competitive algorithms for the submodular matroid secre- 
tary problem for transversal matroids and partition matroids. 

Theorem A.l There is a 48- competitive algorithm for the matroid secretary problem, under a 
transversal matroid with a monotonically increasing submodular valuation function. 

This algorithm is developed to solve a more general bipartite vertex-at-a-time matching problem 
with a submodular valuation function on the set of edges. Notice that partition matroids are 
special cases of transversal matroids. So our result for the transversal matroids already provides 
an improvement comparing with the algorithm in [14]. However, this algorithm cannot handle 
non-monotone submodular functions. 

We then develop an algorithm for the non-monotone submodular secretary problem under par- 
tition matroids, which achieves a significantly better competitive ratio. 

Theorem A. 2 There is an 18- competitive algorithm for the submodular matroid secretary problem 
under a partition matroid. When the valuation function is monotonically increasing, the competitive 
ratio can be improved to 5. 

Our result for the transversal matroid case can be extended to the online matching problem in 
hypergraphs as in [T7]. The algorithm for the partition matroid can be extended to the case that 
one can accept a fixed number of elements from each group, using techniques in [4]. Also, it is 
straightforward to solve the case for graphical matroids. 

Some techniques. With a submodular valuation function /(•), the previously accepted ele- 
ments will affect the valuation of the arriving ones. In this paper, however, we show that one can 
treat the submodular function "obliviously" in the cases of the transversal and partition matroids. 
In fact, our algorithms are simple adaptations from the corresponding algorithms with linearly 
additive valuation functions. On the other hand, the analysis in the submodular case requires new 
techniques. 

For the transversal matroids, we simulate an online algorithm with a randomized greedy al- 
gorithm in Algorithm [3l The randomized greedy algorithm greedily selects elements with highest 
marginal value with respect to M, which is empty at first. However, with half probability, the 
element may either go to M or A^, where N is the set of candidates our algorithm would accept. It 
is natural to expect that f{M) is large. Our result implies, on the other hand, f{N) = il.{f{M)). 
This is rather surprising, since the greedy algorithm is always choosing elements with good marginal 
value respect to Ml To achieve this, we examine the function f{N) + {f{N) -\- f{M) - f{MUN)). 
G The second term can be viewed as the intersection of M and A^. In particular, we show that 
in each step of the randomized greedy algorithm, either f{N) grows or f{N) -\- f{M) — f{M U A^) 
grows in expectation. This observation although simple, is critical in our analysis and we believe 
it might be useful to further understand the submodular secretary problem under other matroid 
constrains. 

For the partition matroids, our algorithm is running r parallel classical secretary algorithms on 
each group of elements. The valuation function is the marginal valuation function with respect to 
the current set of accepted elements. This is counter-intuitive since the decision for the elements 
in one group depends critically on the decisions on other groups. Nevertheless, our analysis shows 
a constant competitive ratio for this simple algorithm. 



^In the analysis, we inspect the set S C N instead. 
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In the analysis, we define the partial permutation set X-i to group permutations that have the 
same positions for elements in all groups other than group i. This grouping is extremely useful to 
decouple the dependencies between the permutation and the marginal valuation function used in 
accepting one element from group i. We show the element in group i that our algorithm accepts is 
expected (over a particular permutation group in X-i) to be "good" comparing with the element of 
the optimal solution in group i with respect to the previously accepted set of elements, which itself 
is a random variable. Therefore, overall, the set of elements accepted by our algorithm is good. 

Related ■work. The secretary problem has been studied decades ago, which is first published 
in [12] and has been folklore even earlier [9]. Motivated by the simple optimal solution for the 
classical secretary problem, several results have appeared for solving more complicated problems in 
this random permutation model. Usually, the goals is to find an independent set which maximize the 
total weight. For example, Kleinberg [16] gave a 1 + 0(l/vA;)-competitive algorithm for selecting 
at most k elements to maximize the sum of the weights. Babaioff et al. [2| considered the Knapsack 
secretary problem, in which each element has weight and size, and the objective is to find a set 
of elements whose total size is at most a given integer such that the total weights are maximized. 
They gave a constant competitive algorithms. Random permutation model is also considered in 
other problems to improve the solution feasibility, e.g. online ads problem [HJ [13], robust stream 
model [5]- 

Babaioff et al. [3] systematically introduced the matroid secretary problem, in which the solution 
has to be an independent set of a matroid and the goal is to find the independent set with maximum 
total weights. As we mentioned earlier, various special cases admit constant competitive ratios. 
The major open problem is to find a constant competitive algorithm for general matroids, if there 
exists. 

The submodular matroid secretary problem, [H [T3] introduces another freedom in the matroid 
secretary problem by allowing the evaluation function to be submodular instead of simply linearly 
additive. Constant competitive algorithms have been developed for the uniform matroids and the 
partition matroids. 

B Preliminary 

In the matroid secretary problem, we assume the elements are arriving in random order. Our 
algorithms have to decide whether to take the current element or not when it arrives. The decision 
cannot be revoked and the set of accepted elements has to form an independent set in the given 
matroid. 

B.l Submodular functions 

In this paper, we assume the quality of the solution is measured by a submodular function. Notice 
that throughout this paper, we only work with non-negative functions. For transversal matroids, we 
assume the submodular function is monotonically increasing. Our algorithm for partition matroids 
works with non-monotone submodular functions as well. 

Definition B.l Let U be the ground set. Let /(•) : 2 — ?• i? 6e a function mapping any subset of 
U to a real number. /(•) is a submodular function if: 

\/S, TQU, fiS) + /(T) > f{S U T) + f{S n T). 
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For simplicity, for any set S* C [/, we define /s(-) as follows. For any T <^ U, fs{T) = 
f{S U T) — f{S). It is not difficult to see that fs{-) is submodular if /(•) is submodular. For 
simplicity, when T = {t} is a singleton, we also write f{t) = f{{t}). 

B.2 Matroids 

In the matroid secretary problem, the set of accepted elements must form an independent set 
defined by a given matroid. 

Definition B.2 (Matroids) Let U ^ f/i be the ground set and X he a set of subsets of U . The 
system Ai = {U, X) is a matroid with independent sets X if: 

1. If AC B CU and B eX, then AeX. 

2. If A, B & X and \A\ < \B\, there exists an element x & B \A such that A U {x} € X. 

In this paper, we work with the following two matroids. 

Definition B.3 (Transversal matroids) Let G = (L, i?, E) he an undirected bipartite graph with 
left nodes in L, right nodes in R and edges in E. In the transversal matroid defined by G, the ground 
set is L and a set of left nodes S C L is independent if there exists a matching in G such that the 
set of left nodes in the matching is S. 

Definition B.4 (Partition matroids) Let [/ = C/i U C/2 U • • • U [/,. be the ground set with disjoint 
subsets Ui and Hi = \Ui\. In the partition matroid defined by M = {U,X), S G U is independent if 
ViE [r], \SnUi\ < 1. 

B.3 Submodular Bipartite Vertex-a-time Matching Problem 

The transversal matroid is defined on matchings of a bipartite graph. Korula and Pal [T7] gener- 
alized the transversal matroid secretary problem to an online bipartite graph matching problem, 
motivated by [7]. We further generalize to submodular valuation functions. In particular, we 
introduce the Submodular Bipartite Vertex- at- a-time Matching (SBVM) problem. 

In the SBVM problem, there is an underlying bipartite graph G{L U R,E). We are given the 
set of right nodes R. The nodes in L, however, are arriving sequentially in random order. When a 
vertex i € L arrives, all edges incident to i are revealed. We assume the availability of an oracle 
for the submodular valuation function, which we can query the function value for any subsets of 
the edges we have seen. We must immediately decide to accept an edge to match i with a vertex 
of R or drop all edges incident to L 

We claim that the matroid secretary problem under a transversal matroid is a special case of 
the SBVM problem, when the valuation function is submodular. In particular, the valuation on L 
in the transversal matroid can be extended to the valuation on the edges E. Let /(•) be a function 
defined on the subsets of L. We define a function g{-) on the subsets of E as follows: for E' C E, 
g(E') = f{L n E'), where LCiE' is the set of left nodes incident to E'E 

Lemma B.5 If f{-) is a monotonically increasing submodular function, g{-) is monotonically in- 
creasing submodular. 



■^The ties in the valuation function have to be broken in a consistent way. 
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Proof: Clearly, if /(•) is monotonically increasing, g{-) must be monotonically increasing. Let 

E" '^ E' (^ E. We have E" D L <^ E' L. Therefore, for any edge e £ E, we want to show that 

giE" U {e}) - g{E") > g{E' n {e}) - giE'). (2) 

If e is sharing the left node with E' , by monotonicity, the left term in Eq. [2js non- negative while 
the right term is zero. So the statement is true. On the other hand, when e is not sharing the left 
node with E' , e is not sharing the left node with E" either. Eq. [2] in this case comes directly from 
the sub modularity of /(•). □ 

Hence, for the submodular matroid secretary problem under a transversal matroid, we can 
extend the valuation function on L to the set of edges in the underlying bipartite graph. The 
optimum solutions for both problems are the same. In fact, if we find a matching, which is a good 
approximation of the SBVM problem, the left nodes of the matching is a good approximation of 
the matroid secretary problem with the same approximation ratio. 

C Algorithm for the SBVM Problem 

Notice that all submodular functions used in this section are monotonically increasing. Recall from 
Section [B] that the submodular matroid secretary problem under a transversal matroid is a special 
case of the submodular bipartite vertex-at-a-time (SBVM) problem. In this section, we show that 
an adapted algorithm from that of [3 [TTj gives a competitive ratio of 48 for the SBVM problem. 
Our adaptation is based on the following algorithm GREEDY. 



Input: G = {L,R,E) and function /(•) 


Output: Matching S 


5^0; 


while {e 5 U {e} is a matching} / do 




e* = argmaxe{/5(e) | S U {e} is a matching}; 




S^SUe*; 


end 


return S; 



Algorithm 5: GREEDY 



Lemma C.l For a bipartite graph G{L, R, E) and a monotonically increasing submodular function 
/(•) > defined on all subsets of E, GREEDY is a 'i- approximate algorithm. 

Proof: First we show that all matchings of G = (L, R, E) can be represented by independent 
sets, which are the intersection of two partition matroids. Both ground sets of these two partition 
matroids are E. In the matroid Afi(i?,Xi)(resp. M2{E,l2)), a set of edges is independent if no two 
edges in it share a left(resp. right) node. It is easy to see that the set of matchings in G is exactly 

XinXa- 

The Theorem 2.1 in [TO] shows that the greedy algorithm is a p + 1 approximation for the 
submodular function maximization problem under the intersection of p matroids. Therefore, our 
algorithm is a 3-approximation. □ 
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We now present our algorithm ONLINE for the SBVM problem. When /(•) is linearly additive, 
this algorithm is identical to the algorithms in [3 [17]. But in general submodular case, our algorithm 
based on GREEDY is simpler and clearer . 



Input: G = {L,R,E) and function /(•) on E. 
Output: Matching ALG. 
k ^ Binom{\L\, i); 

Observe H ^ the first k vertices of L and reject all edges incident to H; 
E' ^ En{H xR); 
M ^ GREEDY ( G{H, R,E')); 
ALG,iV^0; 

for each subsequent i & L\H do 
Ei^En{HU{i} xR); 
Mi ^ GREEDY(G(ii' U {£}, R, E^))- 
if M£ / M then 

Let e^ be the edge in M^ incident to t, 
N = N\j{e,}; 

if ALG U {ei} is a matching then 
ALG^ ALGu{e4; 
Accept ei] 
Continue; 
end 

Reject all edges incident to £; 
end 
end 



Algorithm 6: ONLINE for the SBVM Problem 

In the algorithm, we first observe k = Binom{\L\, 1/2) number of left nodes H while rejecting 
all edges incident to them, where k is the binomial random variable. We build the matching M 
by running GREEDY on the edges E D {H x R). For any subsequent left node (., again we run 
GREEDY on the edges E n {H U {f\ x R) to build a new matching M^. If there exists an edge e^ 
incident to l in Mg, we add e^ into A^, which is a set maintained for later analysis. The edge e^ is 
accepted by our algorithm if it forms a matching with the set of accepted edges so far. 

Korula and Pal [T7] observed that there is a randomized offline algorithm which can simulate 
their online algorithm. In our case, we also describe a closely related algorithm SIMULATE as 
Algorithm [3l SIMULATE is easier to analyze, since it simulates the randomness of the input in 
ONLINE by its internal random coins. In SIMULATE, we have a reference matching M, a working 
set A'' and a result set S '^ N. 

We start with two empty sets M and N. At each time, we pick an edge e = (£, r) greedily with 
respect to function /m(') such that M U {e} is a matching. We then flip a coin. If the coin is head, 
e is added to M. Otherwise, it is added to A^. In both cases, we remove all edges incident to i. 
The algorithm stops when no edge can be picked. 

We introduce the two observations about SIMULATE from [T7]: Once any edge incident to a 
vertex i £ L has been picked, no other edge incident to i will be picked later since we remove all of 
them. Second, multiple edges incident to r £ R might be picked until one of these edges is added 
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Input: G = {L,R,E) and function /(•) 


Output: The set of selected edges S 


M, iV, 5 ^ 0; 


while 3 e* = {i*,r*) = argmaxegg {/jv/Ce) ML) {e} is a matching } do 




Flip a coin with probability 2 of head; 




if head then M ^ M U {e}; 




else A^^ A^U{e}; 




Remove all edges incident to i* from E; 


end 


foreach edge e = {£,r) e N do 


Add e to 5 if e is the only edge incident to r in A^; 


end 


return S; 



Algorithm 7: SIMULATE 

to M. As a consequence, at the end of SIMULATE, M is a matching, but A^ might not be. 

Our final pruning step takes care the case that A^ is not a matching, i.e., there are multiple 
edges incident to the same vertex of R in A^. The final output is a matching S. We will prove 
that 5 is a constant approximation. Before that, we justify the usefulness of SIMULATE by the 
following lemma, which is implicitly assumed in |17j . 



Lemma C.2 The sets of edges of AI and N by SIMULATE has the same joint distribution as the 
M and N generated by ONLINE with a random permutation of the left nodes L. 

Proof: We couple the randomness in SIMULATE and ONLINE as follows. In ONLINE, the 
following randomness is used: (a) the random permutation of L; (b) a random number k = 
Binom{\L\, 1/2). For any particular k and a permutation of L, the probability is (^)2~"'(n!)~^ = 
2~'\k\{n - k)\y^ . 

In SIMULATE, we can associate each node in L with a fair random coin. When SIMULATE 
accesses a coin in processing an edge incident to node £, we simply toss the coin associated with L 
Let H be the set of nodes in L whose coin is head and T = L\H. Define k = \H\. We append 
the randomness of SIMULATE by applying random permutations on H and T. A permutation of 
L is the concatenation of H and T. Consider any particular permutation p of L and k. Let H' be 
the first k nodes in the permutation. In order to generate the permutation, all the coins associated 
with H' must be head and all other coins must be tail. Conditioned on \H\ = k, the probability 
that H' = H is (iy\ 

Pr[p A \H\ =k] = Pr[p \ H' = H] ■ Fv[H' = H\ \H\ = k]- Y>y[\H\ = k] 
= {k\{n - k)\)'^ ■ (^\ ■ ('^^2~'' = 2-'''{k\{n-k)\). 

Therefore, the probabilities of having a particular permutation and k are the same in the two 
algorithms. It is then sufficient to show that both algorithms generate the same M and A^, given 
a fixed permutation of L and H. 
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Notice that M = GREEDY (iJ, R, En{HxR)) in both algorithms, which must be identical. Now 
we prove for TV. Consider an e = {£, r) of A^ in ONLINE. It is in M^ = GREEDY(G(i:fU{^}, R, Ee)). 
Assume e is the i-th edge added in Mg. Let Mj_i be the first i — 1 edges added in M. By GREEDY, 
ei = argmaxeg£;^{/j,/._^(e) | Mj_i U {e} is a matching }. In SIMULATE, after the first i — 1 edges 
are added into M, eg must be tested before the ith edge is added into M. (At least one edge 
incident to i must be tested during this period.) Since the coin associated with i is tail, ee is added 
to N in SIMULATE. 

On the other hand, if eg is in N in SIMULATE. In the execution of ONLINE, adding i into H 
will definitely change the solution of GREEDY. In particular, ee will be added into N in ONLINE, 
since it is the optimal one in all edges incident to i. □ 

C.l Analysis of ONLINE and SIMULATE 

Let OPT be the optimal matching in G. We first study the performance of M. The following 
lemma is very intuitive. 

Lemma C.3 ]E[/(M)] > i/(OPT) . 

Proof: Let OPT' denotes the optimal matching oi H x R. Notice that each edge in OPT is 
in H X R with probability 1/2. By submodularity, E[/(OPT')] > ^/(OPT). RecaU that M = 
GREEBY{G{H,R,E n {H x R). By Lemma EH M is a 3-approximation of OPT'. Therefore 
E[f{M)] > i/(OPT). D 

Let Es be the set of edges picked in SIMULATE. Define Mg be the set of edges in M when e is 
picked. For each node r G R, define e,. S Eg as the first edge incident to r picked in SIMULATE; 
define rur £ M as the edge incident to r. By the submodularity of /(•) and the greedy algorithm, 
we have Jm^ i^r) ^ fMm {"nT-r)- (Both e,- and rrir are random edges, which may not exist. We define 
the frie) = when e does not exist.) Since f{M) = ^reRf^inir(''^r), the following proposition 
can be directly implied. 

Proposition C.4 EreK /^e, (^r) > f{M). 

In order to show the performance of f{S), it is sufficient to compare with XlreR /^^e^ (^r)- 
However, it is not even intuitively clear why there exists a relationship between these two quantities. 
In particular, recall that in SIMULATE, we always pick edges greedily respect to the current M, 
regardless of N and S. 

Instead, we inspect the function F(M, S) = f{S)+{f{M)+f{S)-f{MuS)) during the execution 
of SIMULATE. The second term f{M) + f{S) — f{M U S) can be viewed as the intersection of 
M and 5. Intuitively, when we pick an edge e in SIMULATE, if /A/(e) and /^(e) are comparable 
to each other, the growth of f{S) is good. On the other hand, in case that /5(e) << fM{e), with 
probability 1/2, e is added into M, in which case the "intersection" between M and S grows. The 
proof of the following lemma concretely implements this idea. 

Lemma C.5 E[f{S)] > ^E [EreBJM^Aer)] 

Proof: Consider the function F{M, S). Let M^ and Sr be the set of edges in M and S respectively 
when the edge e,. is picked in SIMULATE. Denote M/. and S'j. as the set of edges in M and 5 after 
Cr is processed. 
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Define A,. = F{Ml,S'^) — F{Mr,Sr)- F{M,S) is monotonically increasing when edges are 
processed in SIMULATE. Therefore, F{M,S) > YlreB.^r- Let J> be the sub-cr-algebra encoding 
all randomness up to the time Cr is picked in SIMULATE. Notice that Mr, Sr and e^ are J> 
measurable. 



E[A, I j;] = Pr[e, G S \ J-,](2/5,(e,) - furUSrier)) + Pr[e, G M | J;](/M,(er) - /M.us.(er)) 
1 1 

> ^(2/s',(er) - fMrUSrier)) + -{fMrier) - fMrUsMr)) 

> 2fMrier) - -^fMrUSrier) 

The last two inequalities come from the submodularity of /(•). Therefore, 

2E[fiS)] > E[F(M, S)] = Y, n^r] = Yl ^^r \n^r I ^r]\ >IY1 E[/M.(e.)] 



4 

rS-R rS-R reR 



Combing the analysis above, we have the following theorem. 



D 



Theorem C.6 There are 48- competitive algorithms for the SBVM problem and the submodular 
matroid secretary problem under a transversal matroid with monotonically increasing submodular 
valuation functions. 

D Algorithms for the partition matroids 

In this section, we develop constant competitive algorithms for the submodular matroid secretary 
problem under partition matroids. Recall that an independent set in a partition matroid contains 
at most one element from each group. 

D.l Monotone submodular functions 

We first discuss the case when /(•) is a monotonically increasing submodular function. Our algo- 
rithm is extremely simple, though the analysis for its performance is subtle to obtain. In fact, we 
parallel run r classical secretary algorithms on each group of elements in PARTITION. 

Let Id(-) be the function which returns the id of the group for a particular element. For group 
i, we observe the first nj/2 elements and reject all of them. For each sub-sequential element in f/j, 
we accept it if it is better than all elements we have seen in Ui, with respect to fs{-) where S is the 
current set of accepted elements. (If the marginal value is negative, we do not accept the current 
element and any element from this group.) 

Notice that 5 is changing in our algorithm. Consider a particular group i and current S. It 
could be the case that we have missed the "best element" in group i respect to /s(') simply because 
S was different when it arrived. So it is rather counter-intuitive that this algorithm is a constant 
competitive algorithm. 

We require more notations. Let OPT = argmax{/(T) | T G X} be the optimal solution and 
S £ I he the output of our algorithm. For a given permutation p of elements in U, let S^ be the 
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Input: Partition matroid Ai = {U,I), function /(•) 
Output: The set of selected elements S £ I 

Vi E [r],Ti ^ 0, Vj E [n^], 6^' ^ false; S ^ 0; 
for eac/i element e £ U do 

^id(e) ^ rid(e) U{e}; 

if (Vj E [nM(e)],^d(e)^* /«^^e) A (|rid(e)| > ^) A (c = argmaXe'eTM(e){/5(e')}) then 

if /5(e) > then 
I 5 ^ 5 U {e}; Accept e; 
end 
end 
end 
return S; 



Algorithm 8: PARTITION 

output of our algorithm. Denote OPTj (resp. Cj, ef) for i E [r] as the element of OPT (resp. S, 
S^) in group i. Let Si (resp. S'f ) be the set of elements accepted by our algorithm when one of the 
bis is set to true in PARTITION. If all 5] are false after the algorithm terminates, we set Si = S. 

Remark on Non-existence. In general, e^ and e^ may not exist. We evaluate fsX^i) ^'^^ 
fs^{^^) to in this case. When /(•) is not monotone, OPTj may not exist as well, in which case 
/T(OPTi) = for any T C [/. 

Our analysis crucially depend on the following definition to group the permutations of the 
arriving elements. 

Definition D.l (Permutation group) For a permutation p of elements U , define Pi{p) he the 
positions ofUi in p. For each i E [r], define the following equivalence relationship on permutations. 
For two permutations x = {xj},y = {yj} E V, they are equivalent if and only if 

Pi(x) = Pi{y) andyj ^ Pi(x), Xj = yj. 
Define Af_j as the set of equivalence groups respect to i. 

For permutations in the same group in X-i, they share the same positions for all elements 
except Ui. Define \p\i E X-i as the permutation group respect to i containing the permutation p. 
When the context is clear, we drop the subscript in [p\i and write [p] as we always consider the 
group i. 

For a permutation p, define the positions of Ui in p as {^1, . . . ,^„.} in increasing order. Now 

define Tf be the set of elements accepted by our algorithm before £,th element arrives in p, if we 
3 '^ 

force our algorithm to reject all elements in Ui. By definition, for any permutation q £ \p\, T- 

is identical to each other. Therefore, we write T- = T? for (7 E [p]. We also define T'^' be the 
elements our algorithm accepts with a permutation in [p], if we force our algorithm to reject all 
elements in Ui. 
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We are interested in the probability that our algorithm accepts an element in group i as well 
as the quality of the element when it is accepted. The following lemma is critical in this section, 
which captures the interesting cases. 

Lemma D.2 Let [x] E X-i be a permutation group, where x is a permutation. Let Pi{x) = 
{ii,i2, . . . ,ini} be the set of positions for elements in Ui in increasing order. Let e\ be the element 
accepted by our algorithm at position ij . We have 



i- Vj G [ui], Pr fi4)> maXe6c/,{/ [,j(e)} p G [x 



1 



20-1) 



2- Vj G [m], Pr 



6;? is true 



p G [x] 



3. Pr 



Vj G [nj],6^ is false |p G [x] 



2i0-i) 
1 

2 



Proof: Consider (1). This is the probability that we accept the best element in group i at position 
(.j., respect to the current set of accepted elements if the marginal gain is positive, which can be 
calculated as follows: a) the best element must at position £j, which is with probability l/rij. b) 
for each Iji for nj/2 < j' < j, our algorithm does not pick the element at position Iji, which is 
with probability (j' — l)/j'. All these probabilities are independent to each other. Therefore, the 
probability for this case is 



1 

m 



2 j-3 
1 ' j - 2 



n,/2 



1 



ni/2 + 1 2(i - 1) 

(2) is the probability that we accept an element at position Ij (if the marginal gain is positive), 
which is not necessarily the best element. We only need to change the term l/rij to 1/j in the 
analysis (a) above. Therefore, the probability is ^ ■("-il • 

Finally, the probability that we do not set any 6;- to true in group i is 



Pr[Vj G [ui], bl is false \p G [x]] = 1 



rii 



j=ni/2+l 



Pr[6^ is true | p G [x]] = 1/2. 



D 
In the first and the second cases above, we mark 6] as true which implies Sf = T- by definition. 
In the third case, Sf = T^^'. The following lemma compares the performance of OPTj with e^ 
respect to Sf. Notice that both Sf and e, are random variables. 

Lemma D.3 Let [x] G X^i be a permutation group. Assume the elements are arriving in a random 
permutation p. We have 

E[fs.{e,)\pG [x]] > h[fsfiOFT,)\pG [x]] . 
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Proof: By definition of Sf and Lemma [0.21 (2), 

E[fsp{OPTi)\p€ [x]] = Y. /th(OPT,) • PT[b{ is trueb e [x]] 

j=n,/2+l ' 

+ Pr[Vj G [j^],4 is false | p G [x]] ■ /^^(OPT,) 
-, "i 

<^-/tn(OPT,)+ Y1 f^OPTi 



j=ni/2+l 



2-i(j-l) 



(3) 



Define ej as the element accepted by our algorithm at position ij. (The issue of non-existence 
is handled in the same way.) We have, 



j=rH/2+l 



11,1 

> Y. /tW(OPT.) • Pr[/^H(eD > /^w(OPT,) b G [2 

i=K/2+l) ' ' ' 

> Y. /7;W(0PT,) • ^^— ^ /* Lemma EJ (1) */ 

/* n, < 2j*/ 



j={ni/2+l) 



] = {ni/2+l) 

> i (E[fs.{OPTi)\pe [x]] - (1/2) • /^h(OPTO) /* Eq.S*/ 

>^E[fs.{OPT,)\pe[ 



X . 



The last inequality comes from the submodularity property of /(•) since Sf C T^^' for p G [x]. □ 
It is then straightforward to bound the performance of f{S). 

Lemma D.4 E[f{S)] > iE[/(S'U OPT)] 

Proof: By linearity of expectation, we have 

E[f{S)]=E[YfsAei)] = Y^ifsM)] = Y E E[/sKeObG[x]]Pr[pGH]. (4) 

i€[r] iG[r] je[r] [x]£X^i 

By Lemma Id. 31 the submodularity of /(•) and the definition of S^, we have 



E[ 



[/(5)] >jY ^He^- [/5f (OPT,) p G [x]\ >jY ^^We^- [/^-(OPT,) p G [ 



i£r] 



i&r] 



= \E^[fsiOP^^)]■ 



iG H 
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Define OPT<j as the set of elements in OPT witli group id smaller than i. Continuing the 
previous derivation, by submodularity, we have 

nf{S)] > ^5]E[/5uopt<,(OPT0] = ^E[/s(OPT)] = ^E[f{SuOFT)]. 

ie[r] 

The last equality comes from /^(OPT) = f{S U OPT) - f{S). □ 

When /(•) is monotonically increasing, we already have a constant competitive algorithm. 

Theorem D.5 There is a 5-competitive algorithm for the matroid secretary problem under a par- 
tition matroid when the valuation function is a monotonically increasing submodular function. 

D.2 Non-monotone submodular functions 

We have shown that PARTITION is 5-competitive when /(•) is a monotonically increasing sub- 
modular function. Notice that, all the results in the previous section can be carried over to the case 
with non-monotone submodular functions. In order to achieve constant competitive ratio in the 
non-monotone case, we need the following simple result. Notice that we always assume /(•) > 0. 

Proposition D.6 Let /(•) be a non-negative submodular function. For any sets A,B,C C^ U such 
that An B = (/>, we have: 

f{AuC) + f{BuC)>f{C). 

The proof is very simple. Notice that {Au C) D {B U C) = C as Ao B = f/>. The inequality 
comes from the submodularity and non-negativeness of /(•). 

Algorithm. We first decide to run our algorithm PARTITION in mode ^ or S by a random 
choice. If we are in mode A, when we want to accept an element e in group i, we flip a coin. If 
the coin is head, we accept the element. Otherwise, we reject this element and never accept any 
element in group i in the future. Symmetrically, we do the opposite in mode B, i.e., only accept 
the element if the coin is tail. 

Our modification simplifies the process in [T3]. Denote ALGa (resp. ALGb) as the output of 
our algorithm in mode A (resp. B). Notice that ALGa and ALG^ have the same distribution and 
ALGyi n ALGs = 0. So it is sufficient to show 

E[ALGa] > Je[ALGa U OPT]. (5) 

For simplicity, we assume we are in mode A. To capture the randomness used by the random 
coins in our algorithm, we associate each element with a fair coin. Let Q be the result of all the 
tosses of the random coins with the elements. 

Now let ef be the element our algorithm accepts in group i with a fixed Q and a permutation p. 
Again Sf is the set of elements our algorithm accepts before e^ is accepted. The non-existence 
issues are handled in the same way as before. The next lemma is almost identical to Lemma ID. 21 
The only difference is when we are about the accept an element, we only accept it if the coin 
associated with it is head. 
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Lemma D.7 Let [x] G Af_j be a permutation group. Let Pi{[x]) = {li,i2, ■ ■ ■ ,ini} be the set of 
position for elements Ui in increasing order. Let Q-i be the sub-a-algebra encoding all the tosses 
of the coins for elements other than Ui. Let e] be the element accepted by our algorithm at position 



£j. We have 



1- yj G [ni], Pr[6^ is true A f (el) > maXeec/J/ M,Q_,(e)} | p G [x],Q^i] 



rpi^l^Q-iK'^JS \F c L-^J)^"iJ — 4(j-l) 



J 



2. \/j G [nj], Pr[6^ is true\p G [x],Q^ 

3. Pr[Vj G K],6^ isfalse\p£ [x],Q. 



2i0-i) 



Notice that in the fohowing lemma fs^^i') is a function defined on a random set Sf even p is 
fixed, i.e., it depends on Q. 

Lemma D.8 Let [x] G X^i be a permutation group. Assume the elements are arriving in a random 
permutation p and we are in mode A. Let Q^i be the sub-a-algebra encoding all the tosses of the 
coins associated with elements other than Ui. We have 

E[/5P(ei)bG [x],Q_,] >^E[/5P(0PTi)bG [x],Q_i]. 

Proof: Let {£±,12, . . . ,ini} be the set of positions in Pi{p) in increasing order for any p G [x]. 

\x] O — 

Define T- * be the set of elements accepted in our algorithm before the £,th element arrives 
in p G [x], if we force the algorithm to reject elements in Ui. Also define T'^'''^^' to be the set of 
elements our algorithm accepts if we force the algorithm to reject elements in Ui. 
Therefore, by definition of 5f and Lemma fP. 71 (2), 



E[/5P(0PT,) |p G [xlQ.i] = g Pr[6^' is true | p G [x],Q.i] ■ /^m,q_,(OPT,) 

j=ni/2+l ^ 

+ Pr[Vj G [ni],bl is false b G N,Q_,] • f^M.Q_,{OFTi) 

Define e] as the element accepted by our algorithm at position ij. (The issue of non-existence 
is handled in the same way.) We have, 
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j=ni/2+l 

= E m^i^iQ-M.)\p^HQ-i] 

j=ni/2+l ^ 

> E Pr[/^H,Q-.(eD > /^M,Q-.(OPT,) b G N,Q_,] • /^H,Q_,(OPT,) 

j=n,/2+l ' ' ' 

^ E ^7— Yy4N.Q-.(OPT.)/*Lemma|E3(l)*/ 

j=n,/2+l ^^ ' ' 

rii -, 

> E /^n(OPT.)-^^— ^•^/*n.<2,*/ 

j=(ni/2+l) 

> ^ (E[fs.{OPTi)\pe [x],Q„,] - i • /yH,Q-,(OPT,)') /* Eq.El*/ 

>^E[/5P(OPT0bGN,Q_,]. 

The last inequality comes from the submodularity property of /(•) and the fact that Sf C T^^''^-"- 
for p £ [x] conditioned on Q-i- □ 

Now we are ready to bound f{S) in mode A. 

Lemma D.9 E[f{S)] > iE[/(5U OPT)] 

Proof: By linearity of expectation, we have 

E[f{S)]=E[J2fsM)] = YnfsAei)] = E E Kfsfiei)\p e [x],Q^,]Pt[p € [x]AQ^i]. 

iG[r] ie[r] iG[r] [x]eX^i,Q^i 

(7) 
By Lemma Id. 81 

nf{S)] > ^E E lE[/5K0PT,)bG [x],Q_,,]Pr[pG [x],Q_,] 

i£[r] [x]eX^i,Q.i 

> ^ E E ^[fsr' (OPT,) \p£[x], Q_i] Pr [p G [x] A Q_,] /* by submodularity */ 

Therefore, E[/(S')] > iE[/(S'UOPT)] using the same analysis as in the proof of Lemma [0.41 □ 
With exactly the same argument, E[ALGb] > ^EfALGB U OPT]. Therefore, we have 
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E[/(ALGa)] + E[/(ALGb)] > ^(E[/(ALGa U OPT)] + E[ALGij U OPT]) 

y 

= ^E[/(ALGa U OPT) + /(ALGb U OPT)] 
y 

> ^/(OPT). 

Notice that our algorithm wih randomly choose ALGyi or ALG^ based on the random choice before 
any element arrives. Clearly, this is an 18-competitive algorithm. 

Theorem D.IO There is an 18-competitive algorithm for the matroid secretary problem under a 
partition matroid when the valuation function is a suhmodular function. 

E Conclusion 

In this paper, we study constant competitive algorithms for the submodular matroid secretary 
problem under transversal matroids and paritition matroids. Some of our results can be extended 
to non- monotone submodular functions as well as some online matching problems. There are still 
a lot of problems remain open. 

One interesting problem is to design constant competitive algorithms for non-monotone sub- 
modular functions under transversal matroids. In particular, our algorithm is using the greedy 
algorithm as a subroutine. When the submodular function is monotone, the greedy algorithm 
guarantees a constant approximation under matroid constrains. This property however fails when 
the function is non-monotone. 

Comparing with the original matroid secretary problem, we are still not able to address the 
laminar matroids and the general truncated matroids in the context of submodular functions. One 
reason is the techniques used in cases with laminar matroids [15] and truncated matroids [3] are 
heavily relied on the distribution of the optimal solutions. In case of submodular functions, it is 
clear that one has to relax our attention to some kind of greedy solutions. 

Ultimately, the conjecture on constant competitive algorithms for the matroid secretary problem 
under general matroids is still widely open even with linearly additive functions. However, we 
suspect that the submodular case might exhibits constant competitive algorithms as well, at least 
for monotone functions. On another direction, one might able to provide constant competitive 
algorithms for the general submodular matroid secretary problem in random assignment model, 
extending the results in |18] . 
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